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ABSTRACT 


An  algorithm  is  developed  for  solving 
a  special  structured  linear  program. 
The  particular  structure  studied  has 
a  large  number  of  blocks  coupled  to¬ 
gether  by  a  relatively  few  connecting 
equations.  The  method  proposed  is  an 
extension  of  f2]  and,  from  the  basis, 
defines  a  working  basis  which  is  much 
smaller  in  size  than  the  original. 

Two  methods  of  updating  the  working 
basis  are  proposed. 


|W*PIH 


INTRODUCTION 

In  this  paper  we  propose  a  device  for  solving  a  large  scale  linear  programming 
problem  of  a  special  configuration.  The  method  proposed  is  an  extension  of  “Gener¬ 
alized  Upper  Bounded  Techniques  -  I"  [2]  to  a  larger  class  of  problems. 

The  special  configuration  is  the  following: 


x  is  a  vector  of  N  components  which  can  be  written  x  =  (xq,  x^ 


where  x.  has  n.  components 

and 

N  =  n  + 
0 

nj+. . .  +n 

A! 

i 

i  s  an 

m  x  n. 

O  I 

matrix; 

A. 

i 

is  an 

m.  x  n. 

i  i 

matrix 

M  =  mQ  +  mj  +  ...+m^  is  the  number  of  equations  of  the  system  which  we  will  as¬ 
sume  to  be  nonredundant  and  which  can  be  written  for  short: 


Although  we  can  save  an  important  computational  work  with  respect  to  the  sim¬ 
plex  method  by  applying  the  decomposition  principle  [l]  to  Problem  O'  we  will,  rather 
taking  advantage  of  the  very  special  condition  L  »  mQ  ,  extend  the  device  given 


.  fetJiut !,»*■— i  II to  . 


ww  JWJ 


■  > 
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by  Oantzig  and  Van  Slyke  in  [2]:  From  the  basis  of  the  system  a  "working  basis" 
is  derived  which  is  considerably  smaller  in  size.  Computations  are  done,  as  much 
as  possible,  on  this  working  basis  which  result  in  a  substantial  savings  in  com¬ 
putation  and  storage.  A  way  is  given  to  find  the  next  working  basis  from  iteration 
to  iteration. 

In  a  first  part  we  give  definitions  and  theorems;  in  a  second  part  we  give  the 
general  method;  and  in  a  third  part  we  give  two  different  ways  of  updating. 


I.  SOME  DEFINITIONS  AND  THEOREMS  -  S.  will  refer  (depending  on  context)  either 
to  the  set  of  components  of  x.  or  to  the  set  of  corresponding  columns  of  the  ma¬ 
trix  A  . 

Suppose  we  are  at  some  stage  of  the  process  and  that  jJ  is  a  basis  for  the 

system.  Let  -  _ 

B! 

i 

0 

B.  i 

i 

„  i 

0 

be  the  contribution  of  the  set  S.  to  the  basis  J3  . 

THEOREM  1 :  At  least  m.  variables  from  each  set  S.  (i  =  1,...,L)  are  ba¬ 
sic. 


Proof:  Suppose  S  has  less  than  m  basic  columns.  Then  there  exists  a 

P  P 

linear  combination  of  rows  of  B  which  vanishes:  (i)  \  B  =  0  .  Now  we  can 

P  P  P 

define  \  =  (0,...,0,  \  ,  0 . 0)  such  that  XB  =  \  B  =  0  ,  which  contradicts 

P  P  P 

the  fact  that  .B  is  nonsingular. 


Remark:  It  follows  from  (i)  that  if 

is  nonsingular. 


B  has  exactly  m 
P  P 


basic  columns,  it 


THEOREM  2:  The  number  of  sets  S.  containing  more  than  m.  basic  variables 
is  at  most  m 

o 
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Proof:  By  the  assumption  of  full  rank,  each  basis  has  exactly  M  vectors. 

By  Theorem  1,  each  set  S.  contains  at  least  m.  basic  variables;  this  leaves 

m  to  make  up  sets  of  more  than  m.  basic  variables, 
o  i 

Definition:  A  set  S.  will  be  said  to  be  essential  if  it  has  more  than  m. 

-  i  | 

basic  variables;  the  set  Sq  is  always  put  in  the  essential  class.  The  other  sets 
will  be  called  inessential. 

§  =  { i | S .  is  essential } 

|  =  { i | S .  is  inessential} 


II.  THE  GENERAL  METHOD  -  The  reduced  system  is  defined  by  deleting  the  subsystems 
A.x.  =  b.  where  S.  is  inessential.  The  set  of  essential  basic  columns  restricted 

iii  i 

to  the  reduced  system  is  our  working  basis  B  . 

The  value  of  inessential  basic  variables  is  determined  from: 

(1 )  B.x!  ■  b. 

'  .  iii 

where  B.  is  square  and  nonsingular.  These  smaller  systems  are  readily  solved. 

THEOREM  3:  The  working  basis  is  a  basis  for  the  reduced  system. 

Proof:  The  number  of  equations  in  the  reduced  system  equals  the  number  of 
variables  in  the  working  basis  since  for  each  inessential  set  we  remove  exactly 
m.  equations  and  in.  basic  columns  from  the  square  basis  B.  .  The  columns  of 
the  working  basis  are  linearly  independent  since  they  differ  from  the  columns  of 
the  basis  J3  by  a  bunch  of  zeros  in  the  inessential  part,  and  the  columns  of  _B 
are  linearly  independent. 

The  size  of  the  working  basis  B  is  m  +  £  m.  ,  considerably  smaller  than 

•€§ 

that  of  J3  .  Note  that  the  size  of  B  changes  from  step  to  step,  and  that  even 
the  number  of  blocks  in  B  (which  is  bounded  by  mQ)  changes  from  step  to  step. 


r  *v 
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Let 


Suppose  we  have  a  basis 
B  ■=  [B  \  I  -  I . |b|] 


jJ  ,  the  columns  of  which  will  be  denoted 
be  the  corresponding  working  basis. 


lj  (j  =  l 


The  problem  is: 

a)  To  determine  which  column  enters  the  basis; 

b)  To  determine  which  column  is  dropped  from  the  basis. 


1)  Let 


JQ  c 

(tt0> 

TT  j  »  • 

•  •  t  TT^  ) 

be 

the 

TT  = 

(tto’ 

"1  l 

ie?) 

be 

the 

Y  ■ 

(Y0’ 

vr- 

*  •  *Y(_) 

be 

the 

£  ■ 

(co’ 

cr* 

•  •  » 

be 

the 

c  = 

(ci| 

ie§) 

be 

the 

The  equation 

(2)  tt  B  -  c 


price  vector  corresponding  to  JJ  ; 
price  vector  corresponding  to  B  ; 
cost  vector; 

cost  vector  associated  with  J3  ; 
cost  vector  associated  with  B  . 


defines  the  price  vector.  The  point  is  that  this  equation  can  be  written 
(2 ' )  ttB  =  c  ; 

(2")  tt  B!  +  tt.B.  =  c.  leg 

'  o  i  i  i  i  * 


We  will  later  give  different  ways  of  solving  (2  * ) ;  (21)  being  solved,  substi¬ 


tuting  ttq  in  (2")  gives  tt.  in  an  easy  way. 

Let  As  and  A|S  denote  the  s**1  column  of  matrices  A  and  A1  respec- 
a  a  a  a 


t ively. 


/  f- 


AS  = 


A1 

i  a 

0 
,s 


* 

\ 


is  the  corresponding  column  of  A  . 


\°J 


"  jar 
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The  column  to  enter  the  basis  will  be  given  by  the  usual  criterion: 


-s  =  s  *s 

V  V  ”  TT  A  = 

Ta  Ta - ct 


Min 

0  <  t  <  L 
1  <  j  <  n 


(y|  -  ha{) 


S  5 

If  y  >  0  ,  we  have  found  an  optimal  basic  solution;  if  not,  we  bring  A  into 

CT  ’ ” CT 

the  basis. 

2)  As  e  S  .  If  S  is  essential  we  have  not  to  worry  about  the  inessential 
“CT  O'  O’ 

part  of  the  problem  which  remains  unchanged.  We  simply  pivot  in  the  reduced  system 
with  the  usual  criterion  for  picking  the  column  to  drop.  We  then  have  to  update 
the  right-hand  side,  and  the  entering  column  is  the  reduced  system.  That  is,  to 


sol  ve 


B  A  ■  A 

CT  CT 


We  postpone  to  a  later  part  the  discussion  of  how  (3)  and  (4)  are  actually 
solved.  Note  that  in  this  case,  since  B  is  assumed  to  be  of  a  reasonable  size, 
the  updating  is  simple. 

If  S  is  not  essential  we  have  to  solve,  instead  of  (3)  and  (4),  the  more 

CT 

complicated  systems: 


B  AS 


A  ; 

CT 


We  will  now  prove  that  solving  (3 ' )  and  (4 ' )  is,  in  fact,  equivalent  to  solving  (3) 


and  (4) . 


Let  A'  ,  b  denote  the  part  of  the  updated  columns  which  correspond  to  the 

CT 


working  basis. 


s  F 


B 


B' 
a  i 


b 


This  can  be  written: 


Bk  bk  ■  bk 


B  b  *  b 

a  c  ct 


bl  bL  -  bL 


<3")  a  "  ft  ]  ’  R  ]  *»  ;  (V,) 


Bb  =  b  -  2  Pi  1  b. 

ie|  L0  -1  ' 


And  we  see  that  if  we  suppose  the  systems  in  (5)  and  (6)  are  of  very  low  order  and 
that  their  solution  is  readily  at  hand,  we  have  only  to  solve  (3")  and  (4"),  which 
are  exactly  of  the  same  type  as  (3)  and  (4). 

By  the  usual  simplex  criterion  we  now  know  which  column  is  to  be  dropped.  Let 
us  suppose  that  the  column  to  be  dropped  belongs  to  the  set  S  .  Two  cases  can 

T 


occur : 


a)  is  inessential,  so  can  only  be  .  Then  the  pivoting  is 


only  done  in  the  inessential  sub-basis  B^  ,  and  the  working  basis  does  not  change. 
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b) 


is  essential,  so  the  method  of  pivoting  is  as  follows: 

Step  1  -  Introduce  in  the  essential  set  (the  size  of  the 

working  basis  is  increased  by  m  )  . 

a 

Step  1 1  -  Pivot  in  the  new  reduced  system. 

Step  III  -  If  the  number  of  variables  in  S  is  now  m  make 

-  T  T 

S^  inessential  (the  size  of  the  working  basis  is  de¬ 
creased  by  m  )  . 

T 


The  algebraic  work  involved  in  Equations  (2')>  (3)  and  (4)  (or  (3M)  and  (4")  ) 
can  be  done  in  essentially  two  ways.  The  first  is  the  Revised  Simplex  Method;  the 
justification  of  using  it  is  that  the  working  basis  will  remain  of  a  reasonable  size. 

The  second  is  to  solve  the  system,  instead  of  inverting  the  matrix  B  ,  by  a  trian- 

/ 

gularization  process  which  is  inspired  of  [3]. 


III.  UPDATING  PROCESS  - 

A.  Revised  Simplex  Method: 

-  ]  iCm  | 

B  ;  we  want  to  find  B  where 


Suppose  we  have  an  inverse  of  the  working  basis 

A 

B  is  the  basis  for  the  next  iteration.  If  S 

a 


is  essential,  we  pivot  in  the  reduced  system  and  simply  apply  the  revised  simplex 

algorithm  in  the  reduced  system.  If  S  and  S  are  inessential,  the  working 

CT  T 

basis  does  not  change.  If  S  is  inessential  and  S  is  essential,  we  will  de¬ 
er  T 

scribe  the  three  steps  outlined  above. 


t  If  the  essential  set  S  had  more  than  m  .  basic  columns  beforehand,  this 

t 

will  not  be  the  case. 


*•  <' 


wi..  15 


T 


then  it  is  easy  to  see  that: 


Step  2.  Now  we  are  as  in  the  first  case  and  we  use  the  modified  simplex  meth- 

|  M  «V  . 

od  to  get  B  (where  B  is  obtained  from  B  by  pivoting  in  the  reduced  system). 

Step  3.  If  Bt  is  now  square,  we  can  rearrange  the  equations  and  variables 
in  B‘  so  that  it  looks  like  this: 
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B.  Compact  Basis  Tr ianqular izat ion:  Any  equations  of  the  type  Bx  =  b  or 
ttB  =  c  where  B  is  an  m  x  m  nonsingular  matrix  can  be  solved  by  triangularizing 
B  (see  [3])*  It  has  been  pointed  out  in  [3]  that  triangularizing  may  be  an  efficient 
method  in  cases  where  B  has  a  special  structure  (such  as  block  angular). 

Triangularizing  is  equivalent  to  pre-mult iplying  B  by  a  set  of  elementary 
matrices  E. 

T  *  Er  E2  ’  *  “  ,EmB 

where,  in  the  notation  of  [3], 


T  is  the  triangular ized  form  of  B  ; 

E.,...,E  is  the  compact  E-structure, 
t  m 


To  solve  ttB  =  c  (Equations  (21)  and  (2")  ),  we  solve 


* 

TT  T  =  C 


and 


n  ■  E, ,  E2,...,EmTT 


* 


To  solve  Bx  =  b  (Equations  (3) » (*0  >  (5)  *  (6)  ),  we  find 


b  "  Er  E2 . Emb 


and  solve 


Tx  =  b 


w 


Having  determined  S  and  S  ,  we  now  show  the  steps  in  pivoting. 

a  t 


If  S  is  essential,  we  pivot  in  the  reduced  working  basis.  If  S  and 
a  o 


S  are  inessential,  we  pivot  in  the  smaller  basis  B  .  If  S  is  inessential 

T  O  O 


and  S  essential,  then  we  show  the  three  steps. 


Let  T  be  the  tr iangular ized  form  of  B  ,  E  its  compact  E-structure, 
a  o  o 


and  J  the  permutation  matrix  used  to  triangularize  B  .  Let  T  be  the 


tr iangularized  form  of  B  ,  and  E  its  compact  E-structure. 


Step  1.  Introducing  into  the  essential  class,  we  modify  the  working 


basis  by  introducing  into  it.  We  get 


New  T 


T 

G 

0 

EJQ 

-H 

B' 

a 


New  E 


m 

Q 

0 

0 

E 

Step  2.  Apply  the  pivot  operation  in  the  new  B  . 

Step  3.  Assume  has  become  inessential;  to  remove  this  block  from  the 


t  h  t  h 

working  basis,  assume  the  columns  of  S  in  B  lie  between  i  and  i+m 

3  T  T 


column.  Define 


.  i+m 


.  i+m 


T. 

0 

T2 

T4 

1 

T3 

i+m 


* 

El 

E4 

. 

E2 

E3 

Then 


^  Note:  If  we  introduce  the  inessential  set  S  at  the  top  LHS  of  the  T  and 

a 

E  ,  we  always  obtain  the  new  E  structure  in  this  manner. 
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triangular ized  form  of  B  ,  and  E  its  compact  E-structure. 

Step  1 .  Introducing  into  the  essential  class,  we  modify  the  working 

basis  by  introducing  into  it.  We  get^ 


Step  2.  Apply  the  pivot  operation  in  the  new  B  . 


Step  3.  Assume  has  become  inessential;  to  remove  this  block  from  the 

^h  £|-) 

working  basis,  assume  the  columns  of  S  in  B  1 ie  between  i  and  i+m 

T  T 

column.  Define 


Then 

^  Note:  If  we  introduce  the  inessential  set  S  at  the  top  LHS  of  the  T  and 

o 

E  ,  we  always  obtain  the  new  E  structure  in  this  manner. 


r 


W,.\X' 


* t 


i)  .I  n^WHwi 


i 


ft 

{  new  T  = 

/ 


new  E  = 


11 


and 


T  -  T- 
t  2 


E  -  E, 

t  2 


In  conclusion,  it  seems  that  Method  A  may  be  preferred  if  the  working  basis 
is  of  small  size  and  if  the  process  of  the  revised  simplex  algorithm  on  it  is  not 
too  long,  as  Method  B  will  be  preferred  if  the  working  basis  itself  is  of  large 
dimension. 
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